Senior Consultant - Data Engineer

Job Title: Senior Consultant - Data Engineer

Career Level: E

Introduction to role:

Are you ready to make a significant impact in the world of data engineering? Join AstraZeneca's Commercial IT Data Analytics & AI (DAAI) team as a Senior Consultant - Data Engineer and become a vital contributor to our data platforms powered by AWS services and Databricks. Based in Chennai GITC, you'll be at the forefront of shaping our quality engineering strategy, leading a team of quality engineers, and driving the success of our data platform initiatives. Dive into the world of data engineering, where your expertise in ETL, Databricks, Datawarehouse, and AWS applications will be crucial in implementing industry best practices and standards. Are you up for the challenge?

Accountabilities:

As the Data Engineer, your key accountabilities will include:

Technical Expertise:

• Design, develop, and implement scalable processes to extract, transform, and load data from various sources into data warehouses.
• Demonstrate expert understanding of the application development processes of AstraZeneca’s implementation of the data product.
• Design, manage, and fine-tune SQL queries and procedures to achieve optimal performance and scalability.
• Work on JIRAs and provide support on production issues and enhancements whenever required.

2. Quality Engineering Standards:

• Monitor and optimize data pipelines, troubleshoot, and resolve any issues that may arise during data processing.
• Maintain quality standards in design, code, and data models, ensuring thorough reviews at each stage of the development life cycle.
• Provide detailed analysis and documentation of processes and flows where necessary.

3. Collaboration:

• Work closely with data engineers to understand data sources, transformations, and dependencies thoroughly.
• Collaborate with cross-functional teams, including Product Owners, Business Analysts, and CriticalOps teams to ensure seamless data integration and reliability.

4. Innovation and Process Improvement:

• Drive the adoption of new technologies and tools to improve data engineering processes and efficiency.
• Recommend and implement enhancements to improve reliability, efficiency, and quality of data processing pipelines.

Essential Skills/Experience:

Education:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.

Skills and Experience:

• Strong experience with SQL, warehousing, and building ETL pipelines using Databricks and AWS cloud.
• Proficient in working with Spark framework, Pyspark, AWS EMR, and AWS Athena.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Deep SQL knowledge to write complex queries for data extraction, transformation, and reporting.
• Excellent communication with the ability to collaborate effectively with technical and non-technical stakeholders.
• Knowledge of database design principles, data modeling, and the ability to translate business requirements into database structures.
• Strong analytical skills with the ability to troubleshoot and deliver solutions in complex data environments.
• Experienced in Agile Development techniques and methodologies.

Desirable Skills/Experience:

• Experience with Databricks, AWS Cloud services like AWS EMR, S3, Glue, Athena, Lambda.
• Proficiency in scripting and programming languages such as Python.
• Prior significant experience working in Pharmaceutical or Healthcare industry IT environment.

When we put unexpected teams in the same room, we unleash bold thinking with the power to inspire life-changing medicines. In-person working gives us the platform we need to connect, work at pace and challenge perceptions. That's why we work, on average, a minimum of three days per week from the office. But that doesn't mean we're not flexible. We balance the expectation of being in the office while respecting individual flexibility. Join us in our unique and ambitious world.

At AstraZeneca, we are committed to driving disruptive transformation on our journey to becoming a digital and data-led enterprise. Our work connects across the entire business to influence patient outcomes positively. Collaborate with leading experts in our specialist communities where innovation meets large-scale impact. Here, you can raise your profile while contributing to life-changing insights that empower patients worldwide.

Ready to take your career to new heights? Apply now and be part of our transformative journey!

Date Posted

25-Jun-2025

Closing Date

01-Jul-2025

AstraZeneca embraces diversity and equality of opportunity.  We are committed to building an inclusive and diverse team representing all backgrounds, with as wide a range of perspectives as possible, and harnessing industry-leading skills.  We believe that the more inclusive we are, the better our work will be.  We welcome and consider applications to join our team from all qualified candidates, regardless of their characteristics.  We comply with all applicable laws and regulations on non-discrimination in employment (and recruitment), as well as work authorization and employment eligibility verification requirements.

]]>

AstraZeneca embraces diversity and equality of opportunity. We are committed to building an inclusive and diverse team representing all backgrounds, with as wide a range of perspectives as possible, and harnessing industry-leading skills. We believe that the more inclusive we are, the better our work will be. We welcome and consider applications to join our team from all qualified candidates, regardless of their characteristics. We comply with all applicable laws and regulations on non-discrimination in employment (and recruitment), as well as work authorisation and employment eligibility verification requirements.